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Abstract 



We prove that a nilpotent subgroup of orientation preserving C 1 dif- 
feomorphisms of S 2 has a finite orbit of period at most two. We also 
prove that a nilpotent subgroup of orientation preserving C 1 diffeo- 
morphisms of M 2 preserving a compact set has a global fixed point. 
These results generalize theorems of Franks, Handel and Parwani for 
the abelian case. 

We show that a nilpotent subgroup of orientation preserving C 1 dif- 
feomorphisms of § 2 that has an odd finite orbit also has a global fixed 
point. Moreover we study the properties of the period two orbits of 
nilpotent fixed-point-free subgroups of orientation preserving C 1 dif- 
feomorphisms of § 2 . 

1. Introduction 

Consider a closed surface S with non- vanishing Euler characteristic. 
The classical Poincare theorem asserts that any C 1 vector field defined 
in S has a singular point. Lima [16] proved that this result can be ex- 
tended to any finite family of pairwise commuting C 1 vector fields and 
then to any continuous action of a connected abelian finite-dimensional 
Lie group G on S. Plante generalized the previous result for connected 
nilpotent finite-dimensional Lie groups |18j . 

If the action is not necessarily connected and continuous the nat- 
ural generalization is studying fixed points for subgroups of Diff^S) 
(the group of isotopic to the identity C l diffeomorphisms of S). The 
Lefschetz fixed point formula implies that any element of Diff^S') has 
a fixed point. An intermediate case between the study of continuous 
actions of Lie algebras and the general case is obtained by consider- 
ing subgroups G of Diff 1 (5') whose generators are close to the identity 
map in the C 1 topology. The orbits of G G are contained in poligonal 
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curves that are almost tangent to the trajectories of a vector field X as- 
sociated to (f> (see [1]). Bonatti took profit of this flow-like behavior to 
prove that any commutative subgroup G of Diff^S 1 ) (x(S) 7^ 0) whose 
generators are C 1 -close to the identity has a global fixed point [3] [I]. 
This result was generalized by Druck, Fang and Firmo for nilpotent 
groups of diffeomorphisms of the sphere in the C 1 -close to the identity 
setting [7]. 

A natural idea is trying to extend the previous results to general sub- 
groups of Diff^S 2 ) by replacing flows (or almost flows) with isotopies. 
In this way Franks, Handel and Parwani solve completely the problem 
of existence of fixed points for commutative groups. They prove that 
an abelian subgroup of DiffJ(S') (x(S) < 0) has always global fixed 
points (and even more that there are fixed points in the identity lift of 
the group) 0. In the case x{S) > 0, i.e. S = § 2 , the group Diff^S 2 ) 
coincides with the group Diff^(§ 2 ) of orientation -preserving diffeomor- 
phisms. In contrast with the other cases there exist fixed-point-free 
commutative groups of Mobius transformations (the group generated 
by two involutions with disjoint fixed point sets such that any involu- 
tion permutes the fixed points of the other involution). Franks, Handel 
and Parwani characterize the subgroups of Diff^(§ 2 ) that have global 
fixed points. 

Theorem 1.1. [9] For any abelian subgroup G o/Diff+(§ 2 ) there is 
a subgroup H of index at most two such that Fix(H) 7^ 0. Moreover, 
Fix(Cr) 7^ if and only if w(<p, rj) — for all <fr, 77 e G. 

The invariant w(<f>, rj) is defined for commuting elements of Homeo + (S 2 ) 
and belongs to Z/2Z (see subsection 15. ip . 

We generalize Theorem 11.11 for nilpotent groups. 

Theorem 1.2. Let G C Diff^S 2 ) be a nilpotent group. Then G has 
an orbit of period at most 2. 

Let us remark that the existence of periodic orbits for nilpotent 
groups of real analytic diffeomorphisms of the sphere was already known 
(GhysHT]). 

The proof of Theorem 11.11 relies on the study of lifts of the group to 
universal coverings of the complementary of some closed invariant sets 
and a fixed point lemma whose generalization for the nilpotent case 
follows. 

Theorem 1.3. Let G C Diff^(lR 2 ) be a finitely generated nilpotent 
group that preserves a non-empty compact set. Then Fix(G) is not 
empty. 
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The following results are applications of Theorem 11.21 

Corollary 1.1. If G is a nilpotent subgroup of Diff^D 2 ) then Fix(G) 
is non- empty. 

Theorem 1.4. (Generalization of Cartwright-Littlewood theorem). Let 
G C Diff+(M 2 ) be a nilpotent group preserving a full continuum K of 
the plane. Then G has a global fixed point in K . 

Let G be a nilpotent subgroup of Diff^(§ 2 ). In general it is not 
possible to define an invariant w : G x G — ?■ Z/2Z such that w is sym- 
metric, it is a morphism of groups in every component and satisfies 
that the subgroups H of G with w\hxh = are exactly the subgroups 
of G that have global fixed points. The group < l/z,iz >C PGL(2, C) 
is an example. It is isomorphic to the dihedral group -D 4 . We de- 
note D 2 =< 1/z, —z >; if the invariant exists then W|_d 2 xd 2 = since 
w(l/z, — z) = 2w(l/z, iz) = but D 2 is fixed-point-free. Anyway we 
can still prove the following parity theorem: 

Theorem 1.5. Let G C Diff^S 2 ) be a nilpotent group. Suppose that 
there exists a finite G-invariant set F such that JjF is odd. Then Fix(G) 
is not empty. 

The previous theorem can be also interpreted as a result on fixed- 
point-free groups. Any finite orbit of a fixed-point-free nilpotent sub- 
group of Diff^(S 2 ) has an even number of elements. We study the 
properties of these groups in section [51 We say that a finite orbit of 
G with p elements is a p-orbit of G. Consider 2-orbits 0\ and 2 of 
a subgroup G of Homeo + (S 2 ). We say that 0\ and 2 belong to the 
same class if we have 

4>\d = Id 4>\o 2 = Id 

for any G G. Curiously fixed-point-free nilpotent subgroups of 
Diff^S 2 ) also have few 2-orbits. 

Theorem 1.6. (Scarcity of 2-orbits). Let G be a fixed-point-free nilpo- 
tent subgroup of Diff^S 2 ). Then the number of classes of 2-orbits is 
either 1 or 3. Moreover, if G is commutative it is 3. 

2. Technical setup 

Let us introduce some of the tools that we are going to use through- 
out the paper. 
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2.1. Groups. The main results are proved by induction on the class 
of nilpotency k of G. 

Definition 2.1. Let G be a group. We denote by Z^(G) the I th 
member of the upper central series of G. If G is nilpotent then c = 
min{£; G N U {0} : Z^ k \G) = G} is the nilpotency class of G. 

Definition 2.2. Let G be a nilpotent group. We say that G is in 
Qk, P if G is a nilpotent group of nilpotency class < k + 1 such that 
G =< Z^ k \G), aii, . . . , a p > for some ot\, . . . , a p G G. 

Remark 2.1. Given a group G =< Z^ k \G), a±, . . . , a p > the group 
< Z (fc) (G), ax,..., a p _i > belongs to £fc, p -i. 

Proposition 2.1. (see page 20 [20jj Lei G be a group acting by isome- 
tries on a finite tree. Then the action has a fixed point. 

2.2. Nielsen classes. A frequent trick in this paper is to consider a 
lift G of G C Diff^ (S> 2 ), deducing properties of G and interpreting them 
in terms of G. 

Definition 2.3. Let G C Homeo + (S') be a group defined in a manifold 
S. We say that G C Homeo + (M) is a lift if 

• M is the universal covering of a G-invariant open set U of S. 
We denote by 7r : M — > U the covering transformation. 

• There exists a unique <fi G G such that o n = n o for any 
4> £ G. Reciprocally given ip G G there exists <f) £ G such that 

O 7T = 7T O '0. 

The group G\u induced by G by restriction to U is isomorphic to G. It 
is clear that Fix(G) + implies Fix(G) n U ^ 0. 

We use Nielsen classes to analyze the properties of the fixed point 
sets of the elements of a lift. 

Definition 2.4. Let <fi G Homeo + (S'). Consider a compact ^-invariant 
set C. Let x, y G Fix(0) \ C We say that x is Nielsen equivalent to y 
relative to C if there exists an arc p from x to y such that p and <j)(p) 
are homotopic relative to endpoints in S \ C. 

Definition 2.5. Let <fi G Homeo + (5'). Consider a compact 0-invariant 
set C. Let a; G Fix(0) \ G. Consider the connected component iV of 
S\C containing x and its universal covering N. We say that <fi : iV — >■ iV 
is a lift of for the Nielsen class of £ if Fix(0) contains a lift of x. 

Notice that x and y are Nielsen equivalent if they belong to the same 
connected component N of S\C and there exists some lift (and hence 
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every lift) : N — > N of 4> for the Nielsen class of x that also fixes a 
lift of y. 

The next definitions are used in Proposition 12.31 (which is indeed the 
Proposition 4.2 of [9]). They are required to relate properties of the 
images of a group G C Diff^(8 2 ) in the group of classes of homeomor- 
phisms modulo isotopy (relative to some compact G-invariant set) with 
properties of G. 

Definition 2.6. Let r] t be an isotopy rel C from 770 = (f) to rji. Consider 
x £ Fix(0) \ C and a lift of 4> for the Nielsen class of x. There exists 
a unique continuous lift fjt of r] t such that fj = <fi. The Nielsen class 
determined by the Nielsen class of x and rj t is by definition the Nielsen 
class determined by fjt, i.e. the elements of the Nielsen class are the 
projections of elements of Fix(r^). 

Definition 2.7. We say that the Nielsen class of x £ Fix(0) \ C is 
compactly covered if there exists some lift (f) : N — > N (and hence 
every lift) of <fi for the Nielsen class of x such that Fix(0) is compact. 

Definition 2.8. Suppose that P is an isolated puncture of N. We say 
that the Nielsen class of a; £ Fix(0) \ C peripherally contains P if there 
is a properly immersed ray p C N based at x that converges to P such 
that 4>(p) is properly homotopic to p relative to x. 

Definition 2.9. Let <\> £ Homeo + (M 2 ). Suppose that C C M 2 is a 
non-empty compact ^-invariant set with C PI Fix(0) = 0. We define 
P(C, <p) as the union of the Nielsen classes of Fix(0) rel C which do 
not peripherally contain 00. 

Periodic points of orientation-preserving homeomorphisms of M? turn 
around fixed points [10J [15J. The next result is a generalization of such 
phenomenon for compact invariant sets with no fixed points. 

Proposition 2.2. (Prop. 5.3 ^\) Let 4> £ Homeo + (lR 2 ). Suppose that 
C C IR 2 is a non-empty compact (^-invariant set with C PI Fix(0) = 0. 
Then P(C, <p) is a non-empty compact set. 

2.3. Realization of subgroups of the mapping class group. An 

idea in fixed point theory is that irreducible models of elements or 
groups contain the minimum possible number of fixed points for ele- 
ments in the same isotopy class. Hence it is natural to study the image 
[G] of a group G in certain mapping class groups. Anyway if we replace 
blindly any element of the group G with a simpler one in its isotopy 
class we lost the algebraic structure; the new group is in general not 
nilpotent even if G was. We need to realize [G] as a nilpotent group of 
orientation-preserving homeomorphisms. 
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Definition 2.10. Let S be a compact surface, perhaps finitely punc- 
tured, with negative Euler characteristic and A be a subgroup of the 
mapping class group of S. We say that A is irreducible if every element 
of A is either pseudo-Anosov or of finite order. 

Lemma 2.1. Let S be a compact surface, perhaps finitely punctured, 
with negative Euler characteristic and A be an irreducible nilpotent sub- 
group of the mapping class group of S. Then there is a homomorphism 
a : A Homeo+ (S) such that a{9) is a canonical Thurston represen- 
tative in the mapping class 9. Moreover if A contains a pseudo-Anosov 
element then <r{A) is generated by a finite group and a pseudo-Anosov 
element. 

Proof. The group A is solvable. Hence it is virtually abelian and finitely 
generated (Theorems A and B of [2J). If there is no pseudo-Anosov class 
in the center of A then A is finite (every finitely generated nilpotent 
group with finite center is finite, see Lemma 0.1, page 3 [TJ). There 
exists a Riemannian metric in S and homomorphism a from A to the 
isometries of S such that for each a & A the element a(a) is in the 
mapping class of a (Kerchoff 's solution of the Nielsen realization prob- 
lem [13]). The realization of the center of a pseudo-Anosov mapping 
class is solved in Lemma 2.10 of [9]. Indeed the center of a pseudo- 
Anosov class [fo] is generated by its subgroup of finite order elements 
and a pseudo-Anosov class [fi\. □ 

Remark 2.2. In this paper we always apply Lemma I2~T1 to finitely punc- 
tured spheres. In such a case we can describe the nature of the subgroup 
of finite order elements of o~(A). The list of finite groups of orientation- 
preserving homeomorphisms defined in the sphere is well known. It 
coincides up to conjugacy with the list of finite groups of orientation 
preserving isometries. The list is composed by cyclic groups C n , di- 
hedral groups D n with 2n elements, At, S4 and 5*5 (see page 40 [21]). 
The unique nilpotent groups in that list are the cyclic groups and the 
dihedral groups D%n for n G N. 

Notice that if o~(A) has non-trivial finite order elements so does the 
center of A. Since finite order elements have exactly two fixed points we 
deduce that cr(A) has either a finite orbit of 2 elements or 2 fixed points. 
Moreover if a(A) has a global fixed point then it has a second one. If 
cr(A) has no torsion elements then it is generated by a pseudo-Anosov 
element and it has at least 2 fixed points. 

2.4. Isotopies and fixed points. The next results are key ingredients 
to translate results for simple models (provided by Lemma I2.ip to the 
initial nilpotent subgroup of Diff ^(S 2 ). 
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Proposition 2.3. (Proposition 4-2 $\) Suppose that 9 : S — )■ S is an 

orientation-preserving homeomorphism of a finitely punctured surface, 
that C is a compact invariant set , that Mj is an essential connected 
9-invariant subsurface of M := S \ C with finite negative Euler char- 
acteristic and that 9\M t is either pseudo-Anosov relative to its puncture 
set or has finite order greater than one. Suppose further that z G Fix(6) 
is contained in the interior of Mi \ C and that ft'-S^tSisan isotopy 
rel C from f = 9 to some f — fx- Let fi be the Nielsen class for 9 rel- 
ative to C determined by z and let v be the Nielsen class for f relative 
to C determined by \x and f t . Then v is non-trivial, compactly covered 
and does not peripherally contain any punctures. 

Suppose that J 7 is a finitely generated group of orientation-preserving 
homeomorphisms defined in a finitely punctured sphere S. Consider 
a compact J-'-invariant subset K C S and a connected essential sub- 
surface Mi of S \ K that is J-'-invariant up to isotopy rel K and has 
negative Euler characteristic. Let M be the connected component of 
S\K containing M±. There is a homeomorphism rj : J 7 — >■ MCG(Mi) 
defined by <p h- > [f\M 1 ] where / is a homeomorphism preserving Mi that 
is isotopic to rel K. 

Proposition 2.4. Consider the notations above. Suppose that T is 
nilpotent and ^{J 7 ) is a non-trivial irreducible group. Let be the 
model for ^(J 7 ) provided by Lemma \2.1\ For each z G Fix(0) that is 
contained in the interior of Mi \ K there exists a lift T of T to the 
universal covering of M\K such that given a non-trivial r)(<j)) the set 
Fix(0) is compact and non-empty. 

Suppose further that T =< Z^^J 7 ), 0i, . . . , <f> v > is a nilpotent group 
of nilpotency class less or equal than k + 1. Then there exist a.\, . . ., a p 
in T such that T =< Z^ k \F), cti, . . . , a p > and Fhc(atj) is a non-empty 
compact set for any 1 < j < p. 

Proof. Let Mi, M be the universal coverings of M 1; M respectively. 
Fix a lift z of z in M\. There exists a unique lift 9 of 9 to Mi such that 
9{z) = z for any 9 G 0. We obtain a lift of 0. 

Given (ft G J 7 consider an element 9 G Homeo + (5') that is isotopic to 
<fi rel K and satisfies 9\m x G 0. The restriction 6\ Ml is uniquely defined. 
By lifting the isotopy from 9 to 4> we obtain a lift <pi : Mi — > M that 
extends uniquely to a homeomorphism (j) : M — > M. The uniqueness of 
the construction implies that <fi i— >■ defines a lift T of J- ' . Proposition 
12.31 implies that Fix(0) is a non-empty compact set if r^(0) is not a 
trivial class. 
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There exists /3 G J 7 such that T)(/3) is non-trivial. Moreover we can 
suppose that (3 belongs to Z^ k \j-) U {(pi, . . . , (p p }. We define otj = <p>j 
if T)(<f>j) is non-trivial and ctj = (pjfi otherwise. □ 

3. Fixed point theorem for the plane 

Theorem 11.31 for commutative groups in Diff^(IR 2 ) was proved in 
[9]. In this section we extend the result to nilpotent groups. More 
precisely, we prove the result for subgroups of Diff^IR 2 ) in Q kp by a 
double induction process, first on p then on k. 

Let us explain the idea of the proof. We consider a nilpotent sub- 
group G of Diff^(R 2 ) as a subgroup of Homeo + (§ 2 ) where all elements 
fix the point at infinity. At this point we consider a G-invariant com- 
pact set K, for instance the fixed point set of a normal subgroup H of 
G. The idea is taking profit of a decomposition a la Thurston (with 
improvements along the lines in [9]) of the classes of isotopy rel K. 
Roughly speaking, the set of isolated points of K is finite and suitable 
to apply a Thurston decomposition whereas the set of accumulation 
points K' of K satisfies that any element of H is isotopic to the iden- 
tity map in the neighborhood of K' rel K' (this property is a conse- 
quence of the smoothness of the elements of G and does not hold true 
for homeomorphisms) . Hence it is natural to require K to be compact 
in M 2 since the elements of G are not C 1 at oo. A technical difficulty 
arises since in general the set Fix(if) is not compact. The following 
statements A kyP , B k , p , Ck, p have hypotheses requiring the group to have 
varying degrees of compactness: 

A k)P : Th. 11.31 holds true for any group G =< Z^{G), (pi , . . . , <j> p > 
of nilpotency class < k + 1 if Fix(0;) is compact for any 1 < I < p. 

B k , P : Th. O] holds true for any group G =< Z (fc) (G), (f> h . . . , (j) p > 
of nilpotency class < k + 1 if Fix < Z^ k \G), (pi, ... , <p> p -i > is compact. 

C kiP : Th. O] holds true for any group G =< Z^ k \G), (pi,...,(p p > 
of nilpotency class < k + 1. 

We can consider the hypotheses in Statements A k p , B k>p , C k ^ p as con- 
ditions of strong, weak and no compactness respectively. The validity 
of C 0i o is obvious whereas C 0) i is a consequence of Brouwer translation 
theorem. Moreover Ck,o implies Ck,i for k > since < Z^ k \G),(p > is 
a group of nilpotency class less or equal than k for any (p G G. 

3.1. Thurston normal form. In this section we provide a Thurston 
decomposition for nilpotent groups of C 1 diffeomorphisms. 

Proposition 3.1. Suppose that S is a finitely punctured surface. Let 
G be a finitely generated nilpotent group o/Diff 1 | _(S'). Consider normal 



subgroups Hi, H 2 of G and G-invariant compact sets K\, K 2 such that 
Ki C Fix(fl'i), K 2 C Fix(# 2 ) \ Fix(#i) and K 1 nK 2 = 0. Suppose 
t/iat one o/ £/ie following properties holds true: 

• K 2 is finite. 

• G E g k>p+1 , H x E G Kp , Ki = Fix{Hi), Fix(iZi) n Fix(# 2 ) = 
and Ck, p holds true. 

Denote M := S\(KillK 2 ). Suppose that x(M) < if^(K 1 UK 2 ) < oo. 

Then there is a finite set R of disjoint simple closed curves (called 
reducing curves ) in M and for any <fi E G there is a homeomorphism 
9 : S —7- S isotopic to <fi rel K\ U K 2 such that 

(1) 6 permutes disjoint open annulus neighborhoods in S of the el- 
ements of R. 

Denote the union of the annular neighborhoods by A, let {Si} 
be the components of S \ A, let Xi = (Ki U K 2 ) D Si and let 
Mi := Si\Xi . Then we have: 

(2) If Xi is infinite then either Xi C Ki or Xi C K 2 . In the former 
case 9\Si = Id if (f> belongs to H\. In the latter case 6^ = Id if 
<p belongs to H 2 . 

(3) If Xi is finite then Mi has negative Euler characteristic and 
9 Ti is either periodic or pseudo-Anosov, where r{ is the smallest 
positive integer such that 9 ri (Mi) = Mi. Moreover, the 9 n for 
4> E G generate a nilpotent subgroup that is either finite or vir- 
tually cyclic, meaning that it has a finite index cyclic subgroup. 

This result is the analogue of Proposition 2.11 of [9j adapted to 
the nilpotent setting. The proof is also similar. We sketch the proof, 
following the presentation of [9] and stressing the points where changes 
are required. 

Definition 3.1. We define the dual tree of R. The vertices are the 
connected components of S \ A. We define an edge for any 7 E R; it 
connects the two connected components of S \ A that share boundary 
components with the annulus neighborhood of 7. If we assign length 
one to every edge, the group G acts on the tree by isometries. 

Suppose that S is a finitely punctured surface. Assume that T is 
a finitely generated subgroup of Diffi(S') and B, C are J-"-invariant 
compact subsets of F such that B C Fix(J r ), C flFix(J r ) = 0. Suppose 
that the image of F in the group of classes of homeomorphisms modulo 
isotopy rel B U C is nilpotent. 

Definition 3.2. Let W(J r , B, C) be the set of compact subsurfaces 
(they can contain punctures) W C S such that: 
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• (W — 1) dW has finitely many components, each of which is 
contained in and is essential in M := S \ (B U C); 

• ( W — 2)W contains all but finitely many points of B and every 
component of W intersects B in an infinite set; 

• (W — 3) for all / G J 7 the following is satisfied: 

— (VV — 3/) there exists <fi : S S isotopic to / rel B U C 
such that 4>\w is the identity. 

The set W(J r , B,C) is not empty if 5 is an infinite set. This is 
Lemma 2.5 of [9] for the commutative case. The proof holds true for 
any finitely generated subgroup of Diff + (5'). 

Consider the setup in Proposition 13.11 The idea is that a maximal 
element W of W(J r , B, C) is unique up to isotopy. If we define T = Hi, 
B — Ki and C = K 2 the uniqueness implies that W is invariant by 
C up to isotopy rel Ki U K 2 . Naturally the connected components of 
W are pieces of the decomposition, they satisfy the condition (2) in 
Proposition 13.11 

Let us prove that W(J r , B, C) has maximal elements. A partial 
order can be defined in W(F, B, C). We have Wi < W 2 for Wi, W 2 € 
W(7, B, C) if Wi is isotopic rel B U C to a subsurface of W 2 but W x is 
not isotopic rel B U C to W2. The next lemma is a version of Lemma 
2.6 of [5] adapted to the nilpotent setting. 

Lemma 3.1. Suppose that B is infinite and that either of the following 
is satisfied. 

• C is finite. 

• J 7 belongs to Qk, P , Cfc,p holds true and B = Fixp 7 ). 
Then W(J r , B, C) has maximal elements. 

Proof. The proof for the case JjC < 00 is the same as in Lemma 2.6 of 
[H] . Moreover they prove that if the result is false there exists a disc D 
in S that is J-'-invariant modulo isotopy rel BUC, disjoint from B and 
such that Cd '■= C fl D is non-empty. 

Let X be the universal covering of 5"\ (B U (C\ Cd))- We choose a 
lift D of D to X. It is also a disc. Given / 6 J 7 there exists a unique 
lift / of / to X such that /(Cd) = Cd where Cd is the lift of Cd to D. 
In this way we obtain a lift J 7 of J 7 to X that preserves the compact 
set Cd- Since Ck, p holds true then Fix(J r ) is non-empty. Therefore 
Fix(J-") PI (S \ B) is not empty. This is absurd. □ 

The Thurston decomposition for nilpotent groups is proved as a part 
of the inductive step (we need to use that Ck, p holds true). This is not 
necessary in [9] since in the case JjC = 00 the group T is always cyclic 
and the contradiction is provided by the Brouwer translation theorem. 
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The set W(J r , B, C) has a unique maximal element, i.e. two maximal 
elements of W(J r , B, C) are isotopic rel BUC. The proofs in Lemmas 
2.7 and 2.8 of [9] apply here. 

Proof of Proposition \3.1\ We follow the steps of Proposition 2.11 of [9] . 
We include a proof for the sake of clarity. 

We define W\ — if K\ is finite, otherwise consider a maximal 
element W\ of W(Hx, Ki, K 2 ). Since ifi is a normal subgroup of G 
and Xi, are G-invariant we obtain that 4>(Wi) is isotopic to W\ rel 
K\ U for any G G. There exists a diffeomorphism 9^ : S — > S such 
that 4> is isotopic to 9^ rel i^i U K 2 and ^(Wj.) = W\ for any G G. 
Moreover we can suppose that (^0) | = Id if (p G 

We denote the finitely puncture surface S \ W\ by S' . Consider a 
set of generators {<f>i, . . . , m } of G such that H 2 =< <f>i, . . . , 4> n > 
for some n < m. We can suppose that {(f>±, . . . , m } and {0i, . . . , n } 
contain set of generators of Hi and i?i fl H 2 respectively. We denote 
G' =< Ofa,..., 9^ > and H' 2 =< 9^, . . . , 9^ n >. They are subgroups 
of Dffi\(S'). Moreover H' 2 is a normal subgroup of G' modulo isotopy 
rel S' n (i^x UiT 2 ). If K 2 is finite we define W 2 = 0. Otherwise consider 
a maximal element 1V 2 of W(H' 2 , K 2 , K\ \ W\). We can suppose that 
{9<t>j)\W2 = Id f° r an y 1 < j < up to an isotopy rel Ki U K 2 . The 
maximal nature of W 2 implies that up to an isotopy rel K\ U K 2 the 
diffeomorphism 9^. preserves W 2 for any 1 < j < in. 

A partial set R' of reducing curves is obtained by removing from 
dW\ UdW 2 the curves bounding an unpunctured annulus and replacing 
them with a core curve of the annulus. In this way we can suppose 
that G satisfies (1) and (2) with respect to R'. We need to find a set 
of reducing curves R containing R' such that (1) still is satisfied and 
(3) holds true. We consider the finitely puncture subsurface S" : = 
S \ {Wi U W 2 ) of S. The image G of G in the mapping class group of 
S" is a nilpotent group. In particular it is virtually abelian (Theorem 
B of [2j). An element of the mapping class group is irreducible if and 
only if an iterate is irreducible. Hence it suffices to prove the existence 
of a Thurston normal form for an abelian group of the mapping class 
group of a finitely punctured surface. Such result is well known, see for 
example Lemma 2.2 of [12J. The mapping class group defined by the 
stabilizer of every finite type subsurface of the decomposition is either 
finite or virtually cyclic by Lemma 12.11 □ 

3.2. Proof of Theorem 11.31 Our point of view is replacing a sub- 
group G of Diff^ (M 2 ) with an irreducible nilpotent model that defines 
the same image in the mapping class group of a subsurface of 1R 2 , ob- 
taining information for the model and then interpreting it for the initial 
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group. One of the reasons because this approach works is that nilpo- 
tent groups are quite rigid. For instance the next lemma implies that in 
Theorem 11.31 we can replace the condition of existence of a G-invariant 
non-empty compact set with the existence of an element of G whose 
fixed point set is a non-empty compact set. A condition on a single 
element implies the existence of a global fixed point for the group. 

Lemma 3.2. Let G =< Z^ k \G), 0i, . . . , <p p > be a finitely generated 
nilpotent subgroup of Diff^IR 2 ) of nilpotency class < k + 1. Suppose 
that there exists a G G such that Fix(a) is a non-empty compact set. 
Suppose further that C kp holds true. Then Fix < Z^(G), <f>i, . . . , <f> p > 
is non-empty. 

Proof. The series 

1 < < Z<®(G),a> < < zV>(G),a> <...<< Z (fe) (G),a> 

is subnormal and every quotient of consecutive subgroups is abelian. 
Let us prove that Fix < Z"'(G), a > is non-empty for any < I < k. 
It is obvious for I = and if I < k the compact set Fix < Z®(G), a > 
is invariant by < Z^ l+1 \G),a >. We obtain Fix < Z^(G),a >^ 
by Statement C kfl . Since < Z^\G) , a > is normal in G, Statement 
Cfc ;P implies that Fix < Z( k \G), 0i, . . . , <f> p > is not empty. □ 

Let G =< ZW(G), > in Gk, P +i- Consider a\ < a 2 < 

. . . < dfe+i and a system of generators {g±, . . . ,g ak+1 } of G such that 
Z^>{G) =< gt, ...,g ai > for any 1 < I < k + 1, a k+1 - a k = p + 1 
and g ak+1 = 0i, • • ., g ak+1 = <p p+ i- We denote G = {Id} and Gj =< 
gi , . . . , gj >. The group Gj is normal in G for any < j < a k+ i. We 
define Jj = Gj for j < a k+1 - 1 and J 0fc+1 -i = G a k+1 -2 for j = a k+1 - 1. 

Lemma 3.3. Let K C Fix(Gj) be a non-empty compact G-invariant 
subset for j < a k+ i. Suppose that C kiP holds true. Then one of the 
following possibilities is satisfied: 

(1) tfnFix(G j+1 )^0. 

(2) There exists a lift GofG such that G =< Z^ k \G), 6l\, . . . , a p+ i > 
and Fix(a;) is a non-empty compact set for any 1 < I < p + 1. 

(3) n0 6 G0(P(if, 0j + i)nFix( Jj)) is a non-empty compact G-invariant 
set. Moreover if j = a k+ \ — 1 then there exists a lift G of G 
such that Fix(0 p+1 ) is non-empty and compact. 

This lemma justifies the introduction of Statements A k>p and B kiP . 
In Cases (1) and (3) for j < a k+ i — 1 there exists a compact non-empty 
G-invariant set F contained in Fix(Gj + i). We can continue the process 
by replacing K with F and Gj with Gj + ±. Otherwise either (2) holds 
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true and G satisfies the hypothesis in Statement Ak tP +i or (3) holds true 
for j = cifc+i — 1 and G satisfies the hypothesis in Statement Bk> p +\. 

Proof. We can suppose that K R Fix(G., +1 ) = 0. Consider a compact 
set K l C K that is minimal by the action of G. We apply Prop. 13.11 
to E x = Gj, H 2 = G, Ki = K 1 , K 2 = 0. Consider the tree T that is 
dual to R (see Def. 13. ip . Then G fixes the vertex that corresponds to 
the connected component of oo. Consider the subtree T 1 of T of 
points fixed by G. If T' = {D^} we define D = D^. Otherwise there 
exists a vertex D ^ of V that belongs to exactly one edge 7 of V. 

Suppose that D R K 1 is finite. Let D be the marked sphere obtained 
from D by contracting D n A. Consider [] : G MCG(G^). The 
model for [G] provided by Lemma 12.11 has exactly a fixed point at 
D H (.4. U {00}) and it does not fix any other puncture or curve in A. 
Hence it fixes an interior point (Remark 12.21) . There exists a lift G 
of G to the universal covering of the connected component of R 2 \ K 1 
containing D\K 1 such that G =< Z^ k \G), a±, . . . , a p+ i > and Fix(5j) 
is a non-empty compact set for any 1 < I < p + 1 (Prop. 12. 4p . 

Suppose D n K 1 is an infinite set. The minimality implies K 1 C D 
and R = 0. In particular all the elements in Gj are isotopic to the 
identity rel K 1 U {00}. 

Consider a compact set K 2 C fT 1 that is minimal by the action 
of Gj+i. Let Eoo be the unbounded connected component of 1R 2 \ K 2 . 
Consider the full compact set K 2 := M. 2 \E OQ . Suppose that Fix(^ + i)n 
K 2 is non-empty. Then there exists a bounded connected component 
D\ of M 2 \ K 2 such that Fix(gj +1 ) PI D\ ^ 0. Moreover the minimality 
implies K 2 C E^, hence D\ is a topological disc. The diffeomorphism 
gj + i has no fixed points in dDi, thus the set Fix((^j +1 )m 1 ) is compact. 
Since D\ is G J+ i-invariant we obtain that Fix < Jj, gj + i > DDi is non- 
empty by Lemma l3~2l Clearly Fix < Jj, gj + i > C\Di and all its iterates 
by elements of G are contained in P^K 1 , gj+i) R Fix(Jj). Moreover 
we define Gj + \ as the group obtained by restricting Gj + i to D\. We 
suppose Fix((7 J+ i) R K 2 = from now on. The set P(K 2 , Qj+i) is equal 
to P(K 2 , Qj+i), it is a non-empty subset of E^ (Prop. 12. 2p . Since 
K 2 is a full compact set then it is not connected, otherwise we obtain 
P(K 2 , Qj+i) = 0. In particular K 2 is not connected. 

Let a : E^ — > E^ be the universal covering of E^. Given G Gj 
let {Pt} te r ij be an isotopy rel K 2 from (3 = Id to 0i = 0. Consider 

the lift {$t} t £[oi] ^° such that (3 = Id. We define = It is 

the identity lift of G Gj to E^; it is uniquely defined since the Euler 
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characteristic of is negative. We define Fix c (0) = <r(Fix(0)) and 
Fix c (Jj) = fl^gj.FiXc^). Let us prove that P(P 2 ,g, + i) D Fix c ( Jj) is 
contained in <f>(P(K, gj+i) D Fix(Jj)) for any G G. Given <p G G we 
have 

a := faj+t^gj^ G fl Z<*>(G) C J,, 

We claim 

(1) P(K 2 ,ag j+1 ) nFix^.) = P(P 2 , g j+l ) fl Fix c ( J,). 

Indeed if an element z of Fix c (J 7 ) fl Fix(<7j+i) does not belong to 
P(K 2 ,agj + i) then there exists a path p from z to oo in § 2 \ P 2 
such that p and (a(7 J+ i)(p) are homotopic relative to ends in S> 2 \ K 2 . 
Let {<yt} t e[o l] ^ e an isotopy rel P 1 U {oo} such that a = Id and 
ol\ = a. We obtain that p and the path qgj + i(p) are homotopic 
relative to their ends in § 2 \ K 2 where q : [0, 1] — > IR 2 \ P 1 is de- 
fined by ^(t) = a~[ 1 (z). The class of ^ is trivial in 7ri(lR 2 \ K 2 ,z) 
since z G Fix c (a). Thus z does not belong to P(P 2 , gj+i). Analo- 
gously we prove that z G (Fix c (J ? ) fl Fix(g,, + i)) \ P(K 2 , gj + i) implies 
z £ P(K 2 ,ag J+l ). 
We deduce 

P(K 2 ,g J+1 ) nFix c (P-) C P(<f>(K),ag j+1 ) n Fix(P-) = 

P(0(iT),^ +1 0- 1 ) n Fix(J,) = cf>(P(K,g j+1 ) n Fix(J,)). 

The inclusion is a consequence of equation ([T]) and P 2 C K. In order 
to prove that n<^ e G<0(P(K, <7 3 -+i) H Fix(Jj)) is non-empty it suffices to 
show that P(K 2 , gj +1 ) D Fix c (Jj) is non-empty 

We apply the Thurston decomposition (Prop. 13. ip to the group Gj + i 
and the marked surface (S> 2 , {oo}) (Pi = Gj, H 2 = Gj + i, K\ = K 2 , 
K 2 = 0). Let D'^ be the connected component of S> 2 \ A that contains 
oo. Suppose that D'^ fl K 2 is of finite type. The minimality implies 
that gj + i can not fix any curve in D'^ fl A. Analogously as in the 
case Jj(P fl K ) < oo Prop. 12.41 implies the existence of a lift Gj+i of 
Gj + \ to such that Fix(g J+1 ) is a non-empty compact set. Moreover 
a(Fix(gj + i)) is contained in P(P 2 , gj+i). We obtain Fix < Jj,gj + \ >^ 
by Lemma [3731 The set P(K 2 , g., +1 )nFix c ( Jj) is not empty, it contains 
a(Fix < Jj,g j+ i >). 

Suppose that D'^ fl K 2 is not of finite type. In this case K 2 is 
contained in D'^ by minimality and R is empty. If there is an essential 
finite type subsurface N C M. 2 \ K 2 preserved by gj + i modulo isotopy 
rel P 2 we can redefine R to be ON . The connected component D'^ of 
infinity in §> 2 \ R satisfies P 2 D D'^ = by minimality. We can argue 
as in the finite type case. 
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Consider a lift z e of a point z in P(K 2 , gj+i). Let be the 
lift of gj + i to -Eqo such that gj + i(z) = z. Since g>j + i does not preserve 
an essential finite type subsurface, Lemma 2.12 of [H] implies that gj +1 
does not fix the homotopy class of any essential non-peripheral closed 
curve. It follows that Fix(^ + i) is compact. No iterate of gj + i belongs 
to Gj, otherwise K 2 is finite. The mapping r : Gj + i — gj+i > 
defined by t\ g . = Id, r(gj+i) = gj + \ is a well-defined homomorphism 
of groups. All the elements of Gj are isotopic to the identity rel K 2 . 
Given 6 Gj+i let {(3 t } t ^ 1 i be an isotopy rel K 2 from /3 = r(0) to 

/?i = 0. Consider the lift {A} tg [oi] to -Eqo such that (3 (z) = z. We 
define <f> = fti. The group Gj +X is a lift of Gj+i to -Eoo by the uniqueness 
of the construction. Moreover Gj is the identity lift of Gj. Lemma [3.21 
implies Fix < Jj,gj +X >^ 0. The Nielsen class of the elements of 
cr(Fix(<7j + i)) is the Nielsen class of z. Thus P(K 2 , gj+i) fl Fxx c (Jj) is 
non-empty. □ 

Let us prove next Ck :P =>■ A k:P+ i and Ck >p ==>- B k p+1 . The proof 
of Cfc iP =>- Ck iP +i is an easy consequence of these results and Lemma 
1331 

Lemma 3.4. Statement Ck tP implies Statement Ak jP+ i for all k > 0, 
P>0. 

Proof. Denote 

H x =< ZV°\G), 0i, • • • , P >, H 2 =< ZW(G), 1; . . . , P _ 1; P+1 > . 

We define K x = Fix(#i) and K 2 = Fix(H 2 ). 

The hypothesis implies that K\ and K 2 are compact. Moreover Ck, P 
implies that none of them is empty. It suffices to prove that Ki{~\K 2 = 
leads to a contradiction. 

We apply Prop. 13.11 to Hi, H 2 . Consider the tree T that is dual to 
R. We define D as in Lemma I'd. 31 It is a G-invariant (modulo isotopy) 
component of § 2 \ A such that there is exactly one point or curve 7 
fixed by G in the union of {00} U (D fl A). If D = we define 
D' = IR 2 . Otherwise we define D' as the connected component of S 2 \7 
not containing 00. We have D C D' . 

Suppose Ki n D' ^ and K 2 n_I>' ^ 0. If n D) = 00 then the 
elements in Hi fix the curves in D C\ A. Since 7^ K 2 flf C Fix(_ff 2 ) 
there exists a curve in .D fl A different than 7 and invariant by the 
group G =< Hi,H 2 >. This is impossible by the choice of D. Hence 
%(Ki n D) = 00 implies K 2 n D' = 0. Analogously tJ(-FT 2 n -D) = 00 
implies Ki fl £)' = 0. Either (i^ U K 2 ) fl -D is finite or one of the sets 
KiHD', K 2 n D' is empty. 
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Suppose that (K\ U K 2 ) D D is a finite set. Let .D be the marked 
sphere obtained from D by contracting the curves in D (1 A. Consider 
[] : G MCG(G| A ). The model for [G] provided by Lemma O has 

exactly a fixed point at Df] (AU {oo}) and it does not fix any other 
puncture or curve in A. Hence it fixes an interior point (Remark 12. 2j) . 
Proposition 12.41 implies that there exists a lift G of G to the universal 
covering of the connected component of M 2 \ (K\ U K 2 ) containing 
D \ (Kt U K 2 ) such that G =< Z {k \G), a x , . . . , a p+ i > and Fix(<x,) is 
a non-empty compact set for any 1 < j < p + 1 . Lemma 13.21 implies 
that Fix < Z( k \G),cti > is a non-empty G-invariant compact set. We 
obtain Fix < Z (fc) (G), <pi, . . . , <p p >^ by Statement C htP . We have 

^ Fix < Z (fe) (G), 0i, . . . , (f> p > n(R 2 \ (Ki U K 2 )) = 0. 

It represents a contradiction. 

Suppose (KC^i U ^2) H -D) = 00. Then either ${K\ D D) = 00 and 
7^2 n D' = or fj(i^ 2 n £)) = 00 and K 1 C\D' = 0. Suppose that we are 
in the latter case without lack of generality. Clearly we have D 7^ D^. 
Consider a lift D' of the disc D 1 to the universal covering M of the 
connected component of 1R 2 \ {{K\ U K 2 ) \ D') containing D'. Let K 
be the lift of (Ki U K 2 ) fl D' in D' . There exists a unique lift G of G 
to M such that = K for any G G. The group G preserves the 

compact set K\ we obtain Fix(-ffi) 7^ and Fix(if 2 ) 7^ by Statement 
Ck, P - We deduce that the intersection of Fix(-ffi) and R 2 \ Ki is not 
empty; this is absurd. □ 

Lemma 3.5. Statement Ck, P implies Statement Bk, p +i for all k > 0, 
p>0. 

Proof. We define Hi, H 2 and K x as in Lemma 13.41 The set Ki is 
compact by hypothesis. We apply Lemma 13.31 If K\ fl Fix(G) is not 
empty there is nothing to prove. If the second Case is satisfied then 
Lemma [3.41 implies Fix(G) 7^ 0. So we can suppose that 

K 2 := n^ G <p(P(Ki, <p p+ i) n Fix < Z<*> (G), (Pi,..., <p p _i >) 

is non-empty. We apply Prop. 13.11 to Hi, H 2 . 

The remainder of the proof is exactly the same as in Lemma 13.41 
except for the case when (t(-Ki H D) = 00 and K 2 fl D' = 0. We apply 
Lemma [3.31 to the compact G-invariant set Ki fl D' . If we are in the 
second Case we obtain Fix(G) 7^ by applying Lemma 13.41 We can 
suppose that 



K' 2 := n^ G <P (P(Ki n D', cj> p+ i) n Fix < Z^(G), 1; . . . , <j) p ^ >) 
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is a non-empty compact G- invariant set contained in K^. We obtain 

K 2 = (K' 2 n D') U (K' 2 \ Tr) = K' 2 \ U< C R 2 \ P(K X n £>', p+ i) 

since 9.D' is invariant by 4> p +i modulo an isotopy rel K\ U K2. This 
contradicts the property K' 2 C P{K\ fl £)', 4> p +i). □ 

Lemma 3.6. Statement Ck, p implies Statement Ck, p +i for all k > 0, 
p>0. 

Proof. Consider the notations above Lemma 13.31 Let K be a compact 
non-empty G-invariant set. We define 

j = max{/ G {0, . . . , a k+1 } : K n Fix(G,-) 7^ 0}. 

If j = afc+i we are done. We apply Lemma 13.31 to K fl Fix(Gj). 
The first Case is impossible by the choice of j. If the second Case 
is satisfied then Fix(G) is non-empty by Lemma 13.41 So we can sup- 
pose that we are in the third Case. If j < a^ +1 — 1 then the set 
n^eG0(-P(-^) 9j+i) H Fix(Gj + i)) is a non-empty compact G-invariant 
set contained in Fix(G J+ i). Up to repeat the argument a finite num- 
ber of times we obtain a compact non-empty compact G-invariant set 
K\ contained in Fix < Z^ k \G), <f>i, . . . ,<f> p >. We apply Lemma [3731 to 
K\. Either G has a global fixed point or the last Case is satisfied. In 
the latter situation there exists a lift G of G such that Fix(0 p+1 ) is 
compact. Lemma [3.51 implies that G (and then G) has a global fixed 
point. □ 

Remark 3.1. Notice that since we already proved Theorem [L3] the con- 
dition requiring Ck, P to be satisfied in Proposition 13. II and Lemmas 13. 1[ 
13.21 and 13.31 is superfluous. 

Proof of Corollary By a theorem of Margulis a subgroup T of 
Homeo + (S 1 ) either contains a non abelian free subgroup or there exists 
a J 7 - invariant probability measure \i [17] . Consider the nilpotent group 
J 7 of restrictions to S 1 = <9D 2 of elements of G. Given an element / G J 7 
such that Fix(/) 7^ the dynamics of / in each interval of 8 1 \Fix(/) is 
conjugate to a translation. We obtain supp(;u) C Fix(/). Thus either 
supp(/i) C Fix(J-") and there is nothing to prove or there exists G G 
such that Fix(0) fl <9B 2 = 0. In the latter case Fix(0) is compact in 
D 2 \ <9ID> 2 . Every finitely generated subgroup of G containing has a 
global fixed point in D 2 \ <9D 2 by Lemma 13.21 Thus G has a global fixed 
point. □ 

Proposition 3.2. Consider the notations in Prop. \2.J\ Suppose that 
T is nilpotent and ^(J 7 ) is a non-trivial irreducible group. Let be 
the model for ^(J 7 ) provided by Lemma l2J[ For each z G Fix(O) that 
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is contained in the interior of Mi there exists x G Fix(J-") D M such 
that: given a non-trivial r)((f)) the (fi-Nielsen class rel K that contains 
x is compactly covered, does not peripherally contains any punctures 
and corresponds, via the isotopy between 9^ and cf), to the 9^-Nielsen 
class rel K that contains z where 9^ G Homeo + (S) is isotopic to <fi and 

| Afi £ ©■ 

Proof. Proposition 12.41 provides a lift J 7 of J 7 to the universal covering 
a : M — >■ M of M. Suppose that 7/(0) is not trivial, then Fix(0) 
is a non-empty compact set. Moreover a(Fix(0)) corresponds to the 
#0-Nielsen class rel K that contains z. Such a Nielsen class does not 
peripherally contain any punctures (Prop. 12. 3p . 

It suffices to prove that Fix (J 7 ) is non-empty. This is a consequence 
of Lemma 13.21 and Theorem 11.31 □ 

4. Existence of orbits of period 2 in the sphere 

Let us discuss briefly the proof of Theorem II .21 It suffices to show the 
result for finitely generated nilpotent groups since a family of compact 
sets satisfying the finite intersection property has non-empty intersec- 
tion. We will see that if Theorem 11.21 holds true for groups in Qk,p 
then any group G G Gk,p+i has a finite orbit. The main ingredient 
of this result is Lemma 14.11 below. Once the finite G-orbit O is fixed 
we consider the Thurston decomposition of G in the marked surface 
(S 2 , O). Roughly speaking we find an invariant connected component 
M of the decomposition and global fixed points for an irreducible nilpo- 
tent model of a normal subgroup of index at most 2 of G (see Remark 
12. 2p . Then we lift this result to the initial group by using Proposition 
I2~4l and Theorem O 

The following lemma is the generalization of Lemma 7.2 of [9] to the 
nilpotent case. 

Lemma 4.1. Suppose that G is a finitely generated nilpotent subgroup 
of Diff^ (S> 2 ), that X C S 2 is a compact G-invariant set and that 7 C 
M := § 2 \ X is an essential simple closed curve. If every element of 
G is isotopic rel X to a homeomorphism that preserves 7 and does not 
interchange the components 0/S 2 \ 7 then Fix(G) 7^ 0. 

Proof. Let Dbea connected component of S 2 \7- Consider the univer- 
sal covering Y of the connected component containing D of E> 2 \(X\D). 
Let D be a lift of D to the topological disc Y . We denote by X the 
lift of X n D to the disc D. There exists a unique lift G of G to Y such 
that 0(X O ) = X for any G G. The set X is compact; there exists a 
global fixed point for G (and then for G) by Th. 11.31 □ 
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Cartwright and Littlewood [6] proved that an orientation preserving 
homeomorphism of M. 2 that leaves a compact nonseparating continuum 
(a compact connected set whose complementary is also connected) K 
invariant leaves a point of K fixed (see [5] for a short proof). We 
generalize Cartwright-Littlewood theorem for nilpotent subgroups of 
Difl^(§ 2 ). 

Proof of Theorem \l-4\ Suppose that the result is false. There exists a 
closed simple curve 7 separating K and Fix(G) U {00} in § 2 . Anal- 
ogously as in Lemma 14.11 we obtain a lift G of G to the universal 
covering of the connected component of R 2 \ Fix(G) containing K such 
that the lift preserves a compact set (a lift of K). Theorem 11.31 implies 
Fix(G) ^ and then Fix(G) n (R 2 \ Fix(G)) ^ 0. □ 

Proof of Theorem II. 2 . It suffices to show the result for finitely gener- 
ated subgroups. A finitely generated nilpotent subgroup is polycyclic, 
so every subgroup is finitely generated (see Theorem 2.7, page 31 |19j). 
The theorem is proved by induction on the class of nilpotency k of G. 
It is obvious for k = 0. We will prove that if the theorem holds true 
for groups in Q kjP then then it is also satisfied for groups in Qk, P +i- The 
result is obviously true for p = and p = 1. 

Let G =< Z<V{G), 0i, ... , >. Our first goal is finding a finite 
orbit for G. The groups 

G x =< Z^ k \G), 1; . . . , P >, G 2 =< Z<*>(G), P+1 > 

are normal in G and have orbits of period at most 2 by the induction 
hypothesis. We define 

H\ =< 2 : G d >, H 2 =< 2 : G G 2 > . 

The group Hj is a characteristic subgroup of Gj and then a normal 
subgroup of G. Moreover \Gj : Hj\ < 00 since Gj is polycyclic (see 
Lemma 4.1, page 57 [19]) for j G {1, 2}. The sets Fix(ifi) and Fix(i^2) 
are non-empty by the existence of orbits of period at most 2 for G\ and 
G 2 . If Fix(# x ) n Fix(H 2 ) y£ then G =< H 1 , H 2 > has a global fixed 
point. Hence G has a finite orbit of period at most \Gi : Hi\\G 2 : H 2 \. 

Suppose Fix(Hi) flFix(if 2 ) = 0. Let R be the set of reducing curves 
provided by Proposition O (K x = Fix(#i), K 2 = Fix(H 2 )). If R ^ 
there exists a finite index normal subgroup H of G fixing all the curves 
in R and the connected components in E> 2 \R (modulo isotopy). Lemma 
14. II implies that H has a global fixed point, thus G has a finite orbit. If 
R = then (j(Fix(i7i) U Fix(# 2 )) < 00 and Fix(#i) is a union of finite 
orbits of G. 
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Consider a finite G-orbit O. Let us apply Thurston normal form 
theorem to the group [G] generated by G in the mapping class group 
of the marked surface (E> 2 ,0). Consider the tree T that is dual to R 
(see Def. 13. ip . The action of G on T has a fixed point r (Prop. 12. ip . 

If r is and edge we can consider a normal subgroup H of G of index 
at most 2 such that H fixes both sides of S 2 \ r. The group H has a 
global fixed point by Lemma 14.11 Hence G has a finite orbit of period 
at most 2. 

We can suppose that G fixes a vertex D of T. Let Z) be the marked 
sphere obtained from D by contracting the curves in D C\ A. Consider 
[]:£?—>■ MCG(Gp); the model for [G] provided by Lemma 12.11 has 
a normal subgroup L of index at most 2 that fixes 2 points (Remark 

We claim that the normal subgroup if := [] _1 (L) of index at most 
2 of G has a global fixed point. If L fixes a curve in .D D A it is a 
consequence of Lemma 14.11 If L fixes a puncture there is nothing to 
prove. We can suppose that L fixes an interior point. There exists a 
lift H of H to the universal covering of S 2 \ such that the fixed point 
set of some element of if is a non-empty compact set by Prop. 12.41 
Hence H has a global fixed point by Lemma 13.21 and Theorem 11.31 We 
obtain a global fixed point for H and a finite orbit of period at most 2 
forG. □ 

5. Fixed-point-free groups 

It is clear that the non-existence of a global fixed point for a subgroup 
G of Difi+(§ 2 ) is related to torsion phenomena (see Remark 12. 2p . So 
it is interesting to identify properties that hold true for finite nilpotent 
groups and to extend them for general nilpotent groups. For instance 
a finite fixed-point-free nilpotent group is a dihedral group D 2 n for 
some n G N. This group has a 2-orbit, two 2 n -orbits and every other 
orbit is a 2 n+1 -orbit. The generalization of this property is provided by 
Theorem II .51 every finite orbit of a fixed-point-free nilpotent subgroup 
of Diff^_(§ 2 ) has an even number of elements. 

Proof of Theorem 11.51 It suffices to prove the theorem for any finitely 
generated subgroup H of G. The set F is a union of orbits of H, so 
H has an odd orbit. We can suppose without lack of generality that 
G is finitely generated and that F is a G-orbit. We also suppose that 
JjF > 3, otherwise there is nothing to prove. 

We apply the Thurston decomposition (Prop. 13. ip to the marked 
surface (S 2 ,F). Consider the dual tree T (see Def. 13. ip . Either there 
exists a connected component D of S 2 \ A that is G-invariant modulo 
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isotopy rel F or there exists an invariant element 7 of R such that 
the components of § 2 \ R are permuted by G. The latter situation is 
impossible since JjF is odd. 

Consider the surface D obtained by contracting the curves in D fl A. 
If D n F 7^ then F is a subset of .D and there are no reducing curves. 
In particular we have D = (§ 2 ,F). We denote F = F. If D n F = 
we define F as the set of points in D corresponding to curves in D fl A. 
Consider a curve 7 in D fl A The connected component D 7 of S 2 \ 7 
such that D 1 fl -D = contains p > 2 points. The action of G on F is 
transitive, hence p does not depend on 7 and JjF = M where q > 3 is 
the cardinal of F. We deduce that JjF is odd. 

Let []:£?—> MCG(-D) be the canonical projection. Consider a 
nilpotent model Go of [G] whose elements are all irreducible (Lemma 
12.11) . By construction F is an odd orbit of Go- Let us show that Go 
has a global fixed point. The group Go is of the form < Tor(Go), fo > 
where Tor(Go) is the normal subgroup of finite order elements of Go 
and either f = Id or f Q is pseudo-Anosov (Lemma 12. ip . The existence 
of a global fixed point is obvious if Tor(G ) = {Id}. 

Suppose Tor(Go) 7^ {Id}. Thus there exists h E Tor(Go) fl ZW(Go) 
with h 7^ Id. If the two points in Fix(h) are not fixed points of Go then 
there exists h' G Go permuting the points in Fix(/i) (and commuting 
with h). A theorem of Handel (see Lemma [5.3p implies h 2 = Id. The 
set F is a union of orbits of h. Since JjF is odd then it contains exactly 
an element of Fix(h). Clearly it is a global fixed point. 

Let us remark that there are no fixed points of Go in F. Since 
[G] 7^ {Id} (the action on punctures and reducing curves is not trivial) 
there exists a lift G of G to the universal covering of § 2 \ F with an 
element a G G satisfying that Fix(a) is non-empty and compact (Prop. 
12.41) . Hence Theorem 1 1 . 3 1 and Lemma T3.2I imply that Fix(G) (and then 
Fix(G)) is not empty. □ 



5.1. Conditions on 2-orbits. We study the structure of the 2-orbits 
of a nilpotent subgroup G of Diff^ (S> 2 ) and no global fixed points. 

Let us begin the section with some examples of finite groups. Con- 
sider the subgroup < l/z,Xz > of PGL(2,C) where A is a primitive 
2 n th root of unity. This group is isomorphic to the dihedral group D^^, . 
Every finite fixed-point-free nilpotent group of orientation preserving 
homeomorphisms is topologically conjugated to -D2™ for some n G N 
(see Remark |2. 21) . The group D2 is commutative and has three 2-orbits 
{0, 00}, {1, —1}, {i, —i}. The group Z) 2 ™ is not commutative and has a 
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unique 2-orbit {0, 00} for any n > 2. We see in this section that nilpo- 
tent subgroups of Diff^(§ 2 ) with no global fixed points share analogous 
properties. 

Definition 5.1. Consider 2-orbits 0\ and 2 of a subgroup G of 
Homeo+(§ 2 ). We say that [O x ] = [0 2 ] if we have 

<p\o l = Id 4>\o 2 = Id 

for any <fi E G. 

Definition 5.2. Consider 2-orbits 0\ y . . ., O n of a subgroup G of 
Homeo + (S> 2 ). The mapping 

r : G (Z/2Z) n 
H> (ai,...,a n ) 

where Oj = if and only if <f>\p = Id is a morphism of groups. We say 
that Oi, . . ., O n are independent if the action of G on Oi U . . . U (9 n is 
(Z/2Z) n , i.e. if t(G) is equal to (Z/2Z) n . 

Remark 5.1. If the classes of 2-orbits Oi, 2 are different ([C?i] 7^ [O2]) 
then the action of G on d U C 2 is Z/2Z x Z/2Z = D 2 . 

Remark 5.2. Two different classes of 2-orbits are always independent. 
This is not the case for 3 classes of 2-orbits. For instance the subgroup 
D2 =< l/z,—z > of PGL(2,C) has three 2-orbits whose classes are 
pairwise different but they are not independent since the action of G 
on the union of the orbits is D 2 . 

Lemma 5.1. Consider 2-orbits 0\, O2, O3, O4 of a subgroup G of 
Homeo + (S> 2 ) whose classes are pairwise different. Then there are three 
of them that are independent. 

Proof. Suppose that there is no subset of 3 independent 2-orbits. We 
can consider the action of G on 0\ U 2 U O s U C 4 as a subgroup of 
(Z/2Z) 4 . Indeed consider the mapping r in Definition 15.21 for n = 4. 
If an element a of t(G) has 2 coordinates aj and (j 7^ k) equal to 
then any other coordinate ai of a is equal to 0. Otherwise Oj, Ok and 
0\ are independent. The projection of r(G) in any 2 coordinates is 
equal to (Z/2Z) 2 since different 2-orbits are independent. We deduce 
that (0, 1, 1, 1) and (1, 0, 1, 1) belong to r(G). Hence its sum (1, 1, 0, 0) 
belongs to t(G) providing an element with exactly two vanishing co- 
ordinates. □ 

We already know that D 2 =< l/z,—z > and -D4 =< l/z,iz > have 3 
and 1 classes of 2-orbits respectively. Moreover the unique commutative 
finite group in Homeo + (S 2 ) with no global fixed point is D 2 that has 
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3 classes of 2-orbits. These properties are generalized in Theorem 11.61 
The next result is a corollary of Theorem 11.61 

Corollary 5.1. Let G C Diff^S 2 ) be a nilpotent group with either 
exactly 2 or at least 4 classes of 2-orbits. Then G has a global fixed 
point. 

Given 0, 77 commuting elements of Homeo+(§ 2 ) there exist isotopies 
4>t and rjt such that 0o = Vo = Id, (f>i — (f>, r)\ = rj. The invariant w((f>, rj) 
is the homotopy class defined by 74 = <f>^ Vt faWt i n vri(Homeo + (S 2 ), Id). 
This group is isomorphic to Z/2Z since Homeo + (§ 2 ) is homotopically 
equivalent to SO (3) (see [H]). Then we can analyze the existence and 
properties of 2-orbits of commutative groups by using Theorem 11.11 
Even if a nilpotent group G C Diff^(S 2 ) (with no global fixed point) 
is not in general commutative we can still apply the properties of the 
invariant w (see [12] [H]) since its image in a certain mapping class 
group is abelian. 

Lemma 5.2. Let G C Diff^S 2 ) be a fixed-point-free nilpotent group. 
Let F be a finite set composed by two or three 2-orbits of G whose 
classes are pairwise different. Then the image [G] of G by the mapping 
[] : G — > MCG(S 2 ,F) is a commutative irreducible group. 

Proof. We apply the Thurston decomposition (Prop. 13. ip to the marked 
surface (S 2 ,F) with E x = H 2 = G, K x = 0, K 2 = 0. Suppose that 
[G] is not irreducible; thus the set R of reducing curves is non-empty. 
Consider the tree T that is dual to R. There is no an invariant element 
7 of R such that the components of S> 2 \ R are permuted by G (modulo 
isotopy rel F) since such property implies that all the 2-orbits in F are 
equivalent. Thus there exists a connected component D of S> 2 \ A that 
is G-invariant modulo isotopy. 

We claim that G fixes a curve in D D A modulo isotopy. Let D' be a 
connected component of S 2 \D. The set D' contains at least 2 points of 
F since curves in R are essential. If F D D' does not contain a 2-orbit 
then there are two equivalent 2-orbits in F. This contradicts the choice 
of F. Hence F D D' contains a 2-orbit and dD D 3D' is G-invariant 
modulo isotopy. Lemma 14.11 implies that G has a global fixed point, 
contradicting the hypothesis. 

Consider a nilpotent model Go of [G] whose elements are all irre- 
ducible (Lemma 12. ip . The set Tor (Go) of finite order elements is a 
subgroup of Go (Lemma l2.ip . It is either a cyclic group C n or a dihedral 
group -D2™ for some n G N (see Remark l2.2p . The set F contains at least 
two disjoint invariant sets of 2 elements of Tor (Go). Hence we obtain 
Tor(G ) = {Id}, Tor(G ) = G 2 or Tor(G ) = D 2 . In the first case G 
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is clearly commutative. In the second case ZW(Gq) PI Tor(Go) 7^ {Id} 
implies Tor(G ) C Z^(G ). Since G /Tor(G ) is cyclic then G is 
commutative. We can suppose Tor (Go) = D 2 . The group Tor (Go) has 
exactly three 2-orbits. Each one of them is the fixed point set of one of 
the three non-trivial elements of Tor(Go). Let h G Tor(Go) \ {Id}. If 
fhf^ 1 = h' h for some / 6 Go then Fix(h) U Fix(Zi') is contained in 
an orbit of Go and Go has at most an invariant set of 2 elements. We 
deduce Tor(G ) C ZW(G ); the group G is commutative. □ 

Definition 5.3. Consider the setup in Lemma [5.21 We can define an 
invariant wf '■ G x G — > Z/2Z. Indeed given 0,77 G G we consider 
elements 0o,?7o G Homeo + (§ 2 ) such that [0] = [<j>o] and [rj\ = [tjq] in 
MCG(S 2 ,F) and 0o?7o = ?7o0o- We define wp(0, 77) = w (0o>?7o)- 

Remark 5.3. Since the center of the group 7ri(§ 2 \ F) is trivial (§ 2 \ F 
has negative Euler characteristic) then the group 7ri(MCG(§ 2 , F), Id) 
is also trivial. In particular the definition of wf{4>, rj) does not depend 
on the choices of 0o and rjo (provided they commute). We can choose 
0o and ^0 i n the group Go defined in Lemma 15.21 

The next lemmas are used to obtain properties of the invariant wf- 
They provide the algebraic structure of the invariant and link the ex- 
istence of fixed points with its vanishing respectively. 

Proposition 5.1. (Prop. 3.2 [9jj Let G be a commutative subgroup 
of Homeo + (S> 2 ). The invariant w:GxG-> Z/2Z is symmetric and 
w(.,g) is a morphism of groups for any g G G. 

Lemma 5.3. (Lemma 1.2 Suppose that rj : S 2 — >• S 2 is a ro- 
tation about some axis by 2irp/q (p/q G Q, < p/q < 1 ) and that 
G Homeo + (§ 2 ) commutes with rj. 

• If interchanges the fixed points Z\ and z 2 ofrj then p/q =1/2 
and w((f>, 77) = 1. 

• If <f>(zi) = z\ and 0(^) = z 2 then w(0, rj) = 0. 

Proof. The first case is Handel's lemma. The second property is an 
easy exercise whose proof we include for the sake of clarity. 

Let A be the open annulus § 2 \{zi, z 2 }. Consider the universal cover- 
ing A of A and a generator T of the group of covering transformations. 
There exists an isotopy rj t rel {zx,z 2 } such that rj = Id and 771 = 77. 
For instance rj t can be a rotation by 2ntp/q. Consider the lift fj t of rj t 
to A such that fjo = Id. Since the class of an element in the mapping 
class group of the twice-punctured sphere is determined by the action 
on the punctures (MCG(So,2) ~ Z/2Z) we consider an isotopy 4> t rel 
{zi,z 2 } such that O = Id and 0i = 0. We consider the lift <p t of 4>t 
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to A such that 0o — Id. We have ff = T p , <f>T = T<p, rjT = Tfj and 
f}4> = T a (j)fi for some oGZ. 
We have 

T p 4> = fj q 4) = T aq 4>fj q = T aq (f)T p = T aq+P 4> p = aq + p a = 0. 

The class of the path 7 Z : [0, 1] — y A defined by j(t) = (<p^ r]^ <j) t r]t)(z) 
is trivial in tti(A, z) for any z £ A since fj(p = (f>fj. The path (fc 1 ^ <f)tT]t 
is trivial in 7Ti(Homeo + (§ 2 , {zi, z 2 }), Id) (see Lemma 1.1 of [12])- We 
deduce u>(0, rf) = 0. □ 

Next proposition encapsulates the properties of the invariant wf that 
allow to prove Theorem 11.61 

Proposition 5.2. Let G C Diff^S 2 ) be a fixed-point-free nilpotent 
group. Let F be a finite set composed by two or three 2-orbits of G 
whose classes are pairwise different. Then we have 

• The invariant Wp :GxG-> Z/2Z is symmetric and WF(.,r]) 
is a morphism of groups for any 77 G G. 

• Given a subgroup H of G such that {wf)\hxh = then H has 
a global fixed point. In particular we have wf ^ 0. 

Proof. The image [G] of G in MCG(S 2 ,F) is an irreducible commu- 
tative group (Lemma 15.21) . Let G be the model of [G] provided by 
Lemma \2. 11 Since w : Go x Go — > Z/2Z is symmetric and a morphism 
of groups in each component (Proposition 15. II) so is %. 

Consider the subgroup H of G that is the image of [H] by the 
isomorphism [G] — > Gq that associates elements defining the same class 
inMCG(§ 2 ,F). 

We claim that Fix(if ) is not empty. If Tor(if ) = {Id} then H is 
cyclic and Fix(H Q ) + 0. Let h G Tor(# ) \ {Id}. The set Fix(h) has 2 
points and it is ifo- mv a r iant. Lemma [5.31 implies Fix(/i) = Fix(i^o)- 

We can suppose Fix(# ) n F = since Fix(H ) n F = Fix(H) n F. 
There exists a lift H of H to the universal covering of S> 2 \ F with an 
element a £ H such that Fix(a) is a non-empty compact set (Prop. 
12.41) . Theorem 1 1 . 3 1 and Lemma [3721 imply that Fix(if) and then Fix(if) 
are not empty. □ 

Consider the hypotheses in Proposition 15.21 In next lemma we see 
that wf is completely determined. The description of wf implies The- 
orem [L6] in a straightforward way. Moreover the mapping wf is simple, 
for instance wf factors through a quotient (isomorphic to D2) of G. 

Lemma 5.4. Let G C Diff^S 2 ) be a fixed- point- free nilpotent group. 
Let F be a finite set composed by two or three 2-orbits of G whose 
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classes are pairwise different. Fix different 2-orbits 0\, 2 contained 
in F. We denote 

Hj = {heG: h\o 3 = Id} for j G {1, 2}. 

Then Hi fl H 2 coincides with J := {0 G G : Wf(4>,t]) = V77 G G}. 
Moreover we have 

• If F is composed of two 2-orbits then there exists a third class 
of 2-orbits for G. 

• If F is composed of three 2-orbits then they are not independent. 

Proof. Consider the image [G] of G in MCG(S 2 ,F). There exists a 
realization o : [G] — > Go of [G] as an irreducible group (Lemma 12. II) . 

The group Hj is a normal subgroup of index 2 of G for j G {1,2}. The 
groups Hi and H 2 are different since [Ox] 7^ [0 2 ]. Consider rji G H 2 \Hi 
and 7/ 2 G Hi\H 2 . The group o~(Hj) has global fixed points in F and 
a (H j)/ Tor (a (Hj)) is cyclic. Lemma 13731 implies that w^H^xa-iHj) is 
trivial and so is {wF)\HjxH y 

Consider G Hi fl H 2 , we have that 7x^(0, a i) — f° r an y a i £ Hi 
since (j) G i?i and wp((p,rii) = since 771, G i^- Since Wf((P,-) is 
a morphism of groups and G =< Hi, 7)1 > we obtain that belongs 
to J. The mapping (wf)|Gxg is not trivial but (wf)\h iX h 1 is. Thus 
there exists (3i G Hi such that Wp(Pi,r]i) = 1. Consider the normal 
subgroup 

Ji = {i 1 eG:w F (r ] ,f3i) = 0} 

of G. It is clear that Hi C Ji, Ji 7^ G and that Ji has index 2. Thus 
Hi and Ji coincide and J is contained in ifi. Analogously we obtain 
J C H 2 . We get J dH 1 r\H 2 and then J = H 1 n H 2 . 

Notice that if O3 is a third 2-orbit in F the previous proof shows 
that J = Hi (1 H 2 (1 H 3 and the orbits of F can not be independent. 

Suppose that F = OiU0 2 . The group G/J— {Id, [771], [7/2], [^1^2]} is 
isomorphic to D 2 . We define H 3 =< J, r]ir] 2 >, it is a normal subgroup 
of index 2 of G such that : H3X H3 — > Z/2Z is the trivial mapping. 
Then H3 has a global fixed point by Proposition 15.21 The group H3 
has no fixed points in F since 7/17/2 does not fix any element of F. Since 
H3 is normal of index 2 in G then there exists a 2-orbit O3 C Fix(i^3). 
We have ij]ir] 2 )\o 3 = Id, (r]ir] 2 )\ 0l 7^ Id and (r]ir] 2 )\ 02 7^ Id. Thus we 
obtain [d] 7^ [0 3 ] and [0 2 ] 7^ [0 3 \. ' " □ 

Corollary 5.2. Lei G C Diff^S 2 ) be a fixed-point-free nilpotent group. 
Then there are no 3 independent 2-orbits. 

Proof of Theorem 11.61 The number of classes of 2-orbits is never 2 since 
the existence of two 2-orbits implies that there is a third one (Lemma 
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I5.4p . Moreover such a number can not be greater than 3 by Lemma 
15.11 and Corollary 15.21 

Suppose that G is commutative. Let 0\ be a 2-orbit of G. We 
denote H\ = {0 G G : 4>\Oi = ^0- Since 0\ is contained in Fix (Hi) 
we deduce that w : Hi x Hi — y Z/2Z is the trivial mapping (Theorem 
11.11) . Theorem 11.11 also implies that w : G x G — ?■ Z/2Z is not trivial. 
Let 771 G G \ Hi Since Hi is an index 2 normal subgroup of G and 
w (ViiVi) = there exists «i G Hi such that u^ai,^) = 1. We define 

ff 2 = {^G:^ ))?1 )=0}. 

The group H 2 is normal in G, moreover it has index 2 since oti G Hi\H 2 . 
Thus J := HiflH 2 is a normal subgroup of G of index 4. Indeed we have 
H 2 =< J, T]i >. Since w^xi/i = and w\H 2 x{rii} = then we deduce 
r w\H 2 xH 2 = 0. Hence the set Fix(H 2 ) is non-empty (Theorem II. ip . 
There exists a 2-orbit (9 2 of G contained in Fix(H 2 ). Since (?7i)|e> 2 = Id 
and (771)10! ^ Id then we obtain [Oi] 7^ [C 2 ]. The group G has 3 classes 
of 2-orbits by the first part of the proof. □ 

Theorems 11.51 and 11.61 for commutative groups admit simple proofs 
by using only the characterization of commutative subgroups G of 
Diff^S 2 ) with global fixed points of [H] (see Theorem 11.11) . 

Corollary 5.3. Let G C Diff^ (S 2 ) be a fixed-point-free nilpotent group. 
Let J be the subgroup of elements of G fixing every 2-orbit pointwise. 
Then it is a normal subgroup such that G/J ~ Z/2Z or G/J ~ D2 
depending on whether there are 1 or 3 classes of 2-orbits. 
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